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Abstract 

A combined statistical analysis of the experimental results of the LSND and KARMEN ► v e 
oscillation search is presented. LSND has evidence for neutrino oscillations that is not confirmed by 
the KARMEN experiment. This joint analysis is based on the final likelihood results for both data 
sets. A frequentist approach is applied to deduce confidence regions. At a combined confidence 
level of 36%, there is no area of oscillation parameters compatible with both experiments. For 
the complementary confidence of 1 — 0.36 = 64 %, there are two well defined regions of oscillation 
parameters (sin 2 (2B),Am 2 ) compatible with both experiments. 
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I. INTRODUCTION 



Currently, there are three neutrino anomalies interpreted as evidence for neutrino oscilla- 
tions, namely the atmospheric [l[], the solar [fj] and the LSND || anomaly with three distinct 
squared neutrino mass differences. However, oscillations between the three Standard Model 
(SM) neutrinos are described by only two independent neutrino mass-squared differences, al- 
lowing only two of the above anomalies as being due to oscillations in a SM scenario extended 
by massive neutrinos. Before enlarging the neutrino sector by some additional, unknown 
sterile neutrinos, each of the experimental results has to be checked independently. 

Over the last years, the controversial results of the two experiments LSND (Liquid Scintil- 
lator Neutrino Detector at LANSCE, Los Alamos, USA) and KARMEN (KArlsruhe Ruther- 
ford Medium Energy Neutrino experiment at ISIS, Rutherford, UK) both searching for neu- 
trino oscillations v ^ — > v e in a short baseline regime, have led to intense discussions. The two 
experiments are similar as they use beams from the 7r + -/i + decay at rest (DAR) chain 
7r + ^ followed by fi + —>■ e + + v e + with energies up to 52MeV. Furthermore, 

both experiments are looking for v e from v^— > v e oscillations according to the two-flavor 
oscillation probability |29| 

q . . 9 / Am 2 • L\ , 
P(P^ v e ) = sin 2 (26) sin 2 ( 1.27— - J (1.1) 

with the difference of the squared masses Am 2 in eV 2 /c 4 , the flight length of the neutrino L 
in meters and the neutrino energy E u in units of MeV. The detection reaction p ( v e , e + ) n 
provides a spatially correlated delayed coincidence signature of a prompt e + and a subsequent 
neutron capture signal. 

This paper describes a combined statistical analysis of the final LSND and KARMEN 2 
results. There are significant changes to the treatment of LSND data in the final LSND 
paper ||. The present paper uses only the decay-at-rest (DAR) v ^ — > u e data, and leaves 
out the impact of the decay-in-flight (DIF) v^— > v e data. As shown later, the LSND data 
has a favored region in the 7eV 2 /c 4 region of Am 2 as a consequence of this change. This is 
in contrast to the LSND result |§ which disfavors this solution at 90% CL. because of the 
inclusion of the DIF flux. A motivation for this change is that a direct comparison of the 
two experiments is less model dependent if one considers the LSND DAR flux only, since 
KARMEN does not have a DIF neutrino flux present in its source. 
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The analysis is based on a frequentist approach following the suggestions of ||. For 
both experiments, the data are analysed with a maximum likelihood analysis followed by 
the extraction of confidence levels in a unfied approach. It is not the task nor the purpose 
of this analysis to treat the apparent disagreement between the two experiments. Rather, 
assuming no serious systematical error in either experiment or their interpretation with 
respect to v^-^ v e oscillation, we apply a consistent statistical analysis to quantitatively 
establish their level of compatibility. The work follows an earlier analysis || based on 
intermediate data sets. 

There are two separate questions investigated in this paper that relate to the LSND and 
KARMEN data. The first question is: at what level are the two data sets compatible with 
each other? This question addresses whether or not the two experiments force one to draw 
opposite conclusions from their respective data. 

If one assumes that the data sets are compatible, the second question becomes: what are 
the most likely regions for the oscillation parameters? This method is somewhat analogous 
to treating the KARMEN data as coming from a 'near detector' at 17 meters, and treating 
the LSND data as coming from a 'far detector' at 30 meters. It ignores the question of 
systematic differences between the experiments, such as whether or not, for example, an 
unaccounted source of u e background neutrinos was present in the LSND data and not 
present in the KARMEN data. 

The paper is organized as follows: After a short overview of the experimental setups of 
both experiments, section || describes the data analyses leading to likelihood functions of the 



oscillation parameters. Section |TJ is devoted to the extraction of confidence regions for the 
individual experiments. In section |TV| , the experimental results are combined statistically, 
extracting levels of compatibility as well as oscillation parameters compatible with both 
experiments. We conclude with implications of this joint analysis, a comparison with other 
oscillation searches and an outlook to upcoming experimental tests of the favored oscillation 
parameters presented in this analysis. 

A. The LSND experiment 

The source of neutrinos for the LSND experiment was the interaction of the 798 MeV 
proton beam at the Los Alamos Neutron Science Center (LANSCE), in which a large number 
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of pions, mostly ir + are produced. The ir~ are mainly absorbed and only a small fraction 
decay to which in turn are largely captured. Thus, the resulting neutrino source is 
dominantly due to tt + -^ and fi + — * e + + v e + decays, most of which decay at 

rest (DAR). With a very small contamination of v e l^p, ~ 8 • 10~ 4 , a measurement of the 
reaction v e + p — > n + e + provides a sensitive way to search for v^— > v e oscillations. Such 
events are identified by detection of both the e + and the 2.2 MeV 7 from the reaction 
p ( n,7 ) d. In addition, the v e flux from 7r + and fi + decay-in-flight (DIF) is very small, which 
allows a search for v^— > v e oscillations via the measurement of electrons above the Michel 
electron endpoint from the reaction 12 C ( v e , e~ ) 12 N. 

The LSND experiment took data over six calendar years (1993-1998). During this period 
the LANSCE accelerator operated for 17 months, delivering 28 896 C of protons on the 
production target. The LSND detector || consisted of an approximately cylindrical tank 
8.3 m long by 5.7m in diameter. The center of the detector was located 30 m from the beam 
stop neutrino source. The tank was filled with liquid scintillator consisting of mineral oil 
and 0.031 g/1 of b-PBD. This low scintillator concentration allowed the detection of both 
Cerenkov light and scintillation light. Photomultiplier time and pulse-height signals were 
used to reconstruct the track with an average RMS position resolution of ~ 14 cm and an 
energy resolution of ~ 7% at the Michel endpoint of 52.8 MeV. 

B. The KARMEN experiment 

The KARMEN experiment used as neutrino source the pulsed spallation neutron source 
ISIS of the Rutherford Appleton Laboratory delivering 800 MeV protons. In contrast to the 
LANSCE source, the protons are extracted from the synchrotron as an intense but narrow 
double pulse, consisting of two parabolic pulses with a width of 100 ns separated by a peak- 
to-peak gap of 325 ns. The unique time structure of the ISIS proton pulses allowed a clear 
separation of neutrino-induced events from any beam unrelated background. The intrinsic 
contamination of the ISIS z/^-beam is u e /v^ = 6.4 • 10~ 4 |7[]. 

The KARMEN detector |§ was a rectangular high resolution liquid scintillation calorime- 
ter, located at a mean distance of 17.7 m from the ISIS target at an angle of 100 degrees 
relative to the proton beam. The liquid scintillator was enclosed by a multilayer active 
veto system and a 7000 1 steel shielding. The 65 m 3 of liquid scintillator consisted of a 
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mixture of paraffin oil (75%vol.), Pseudocumene (25%vol.) and 2g/l scintillating additive 
l-phenyl-3-mesityl-2-pyrazoline. The liquid scintillator volume was optically separated into 
512 independent central modules. Gadolinium was implemented between the module walls 
for an efficient detection of thermal neutrons Gd ( n,7 ) with on average 3 7's of energy 
J2 E~ = 8 MeV. The KARMEN detector as liquid scintillator calorimeter was optimized for 



high energy resolution of oe = 11.5%/y E'(MeV). Each event had energy, time and position 
information, as well as the number of addressed modules and their relative time differences. 

The KARMEN 2 experiment took data from February 1997 to March 2001. During this 
time, protons equivalent to a total charge of 9425 Coulombs have been accumulated on the 
ISIS target. This corresponds to 2.71 • 10 21 from the ISIS beam stop target. 

II. DATA ANALYSIS AND RESULTS AS LIKELIHOOD FUNCTIONS 

For both experiments, a v e signal from — > v e oscillations consists of a spatially correlated 
delayed (e + ,n) sequence from p(z/ e ,e + )n . Due to the different experimental techniques, 
the parameters to identify such sequences vary. Details of the LSND event reconstruction 
can be found in |J and f| , the requirements for event sequences in KARMEN are described 



In LSND, a (e + ,n) sequence requires a prompt 'electron-like' event with energy E e > 
20 MeV followed by a low energy 7-event. The information about the delayed event is 
characterized via a likelihood ratio i? 7 : If within one millisecond after the initial event 
another event is recorded at distance Ar < 250 cm, the likelihood ratio _R 7 in energy (PMT 
hits), time and distance of being a correlated p(n,7) over an accidental coincidence is 
calculated, otherwise _R 7 = 0. Requiring a high likelihood ratio _R 7 selects (e + ,n) correlated 
events with low uncorrelated background, the so-called "gold-plated" events. However, to 
determine the oscillation parameters sin 2 (20) and Am 2 in a likelihood analysis, an event 
sample with a much looser cut in i? 7 is used, leading to higher efficiency for the oscillation 
channel, but naturally increasing the background. For the LSND sample analysed here, all 
the cuts described in || have been applied with two exceptions: The energy of the prompt 
event has been restricted to 20 < E e < 60 MeV instead of 20 < E e < 200 MeV and we 
applied a loose cut of i? 7 > 10~ 5 instead of no i? 7 -cut at all. The reason for these changes is 
twofold. First, the upper energy cut E e < 60 MeV excludes any significant influence of the 
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FIG. 1: LSND data ensemble, together with the BUB (dashed), BRB (dotted) and total background 
expectations BUB+BRB (dashed-dotted) : (a) electron energy, (b) i? 7 , (c) spatial distribution along 
detector axis, and (d) directional angle cos^. 



u e channel on the much more sensitive v^— > v e channel. For any value of the oscillation 



parameter Am 2 , the expected contribution from v^^v e remains below 2% of the ^ M 



signal. The second reason is a more technical one. Applying a unified frequent ist approach 
to the likelihood function gained from the reduced data implies simulation and analysis of 
a large number of event samples analog to the experiment. Therefore, one is interested not 
to have too large samples containing mainly background events. With the cuts above, the 
original event sample is reduced by a factor of 5.5 to 1032 candidates, with an efficiency 
for v^-^Vf, at high Am 2 reduced to 64.4% of the original one (only 3.2% of the expected 
v^~ > v e events remain). 

Figure [TJ shows the event sample comprising 1032 beam-on events. Four variables are 
used to categorize the events: The energy of the primary electron E e , its spatial distribution 



along the detector axis z |3(J and the angle cos6 u between the direction of the incident 
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TABLE I: Contributions to the LSND data sample of different beam-related (BRB 3-6,8) 
and beam-unrelated (BUB) background processes as well as the expected oscillation events for 
sin 2 (26) = 1, Am 2 = 100eV 2 /c 4 . 

Contribution Signal or Background Source Process Expected Number of Events 
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neutrino and the reconstructed electron path. The fourth variable is the likelihood ratio 
i? 7 for a (e + ,n) coincidence. The binning of this distribution with the upper edge of bin 
number N representing a value _R 7 = 10 N ^ 3 ~ 1 has been chosen for practical reasons. Note 
that the spectra in Figure [I] are projections of a 4-dim space of correlated parameters for 
each event. Superimposed to the data are shown the beam- unrelated and beam-related 
background contributions amounting to a total number of N^ d = 971.9 events. The expected 
background contributions are broken down in Table |, for further details we refer to ||. 

Formally, each beam-on event j of the A 1 beam-on — 1032 candidates is assigned a proba- 
bility Pj(x) equal to a sum of probabilities qi(x) from the backgrounds plus oscillations. The 
vector x describes herein the spectral parameters of each event j, Xj = (E e j, Ryj, cos 9 U j, Zj). 
It then remains to add the with expected fractional contributions and take the product 
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over all the beam-on events. The likelihood is thus 



am — cm 



N bean 

£=( n Pii (2- 1 ) 

3=1 

where 

contr. 

Pj(xj) = J2 Qi(xj)-ri. (2.2) 

i=l 

Additionally, two normalization requirements must hold: 

■^V contr. 

E ri = l, (2.3) 

t=i 

and 

y dE e dR^ c?(cos ^) <iz qi(E e} i? 7 , cos 2) = 1 (2.4) 

for each contribution, z. Together, these requirements ensure that every observed beam-on 
event has a probability of occurrence equal to 1. 

To allow for the fact that the backgrounds are known to some limited accuracy only, the 
background is varied by calculating the above likelihood at each point in the (sin 2 (20), Am 2 ) 
plane many times, varying over the expected a for each background. For each background 
configuration, the £ is weighted with a Gaussian factor for each background that is off its 
central value. The background variations are performed in a simplified manner, i.e. the 
beam-unrelated background (BUB) varies independently and all the beam-related back- 
grounds (BRBs) are locked together. Finally, the likelihood can be expressed as 

P ^beam — on 

C = J VN bgd exp(-(N bgd -N bgd , exp ) 2 /2a 2 )- JJ Pj , (2.5) 

j=i 

where the / VN bg d represents, schematically, the background variation described above. 
Integrating over different background contributions eventually reduces the free parameters 
of the likelihood procedure from N contr , + 1 to the 2 free parameters of real interest within 
this analysis, the oscillation parameters: 

£(n, . . . r Ncontr _ u sin 2 (20), Am 2 ) -> £(sin 2 (20), Am 2 ) (2.6) 

Figure shows the logarithm of the event-based likelihood function, ln£(sin 2 (20), Am 2 ), 
for the 1032 events investigated. The maximum is reached at a parameter combination 
(sin 2 (20)=O.85, Am 2 =0.055eV 2 /c 4 ) corresponding to a total oscillation signal of A^ osc = 
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FIG. 2: LSND logarithmic likelihood function In C (sin 2 (29), Am 2 ) 



u e ) + iV(z/ At — > v e ) = 66.4 + 0.3 = 66.7. The difference to the no-oscillation hypothesis 
as expressed in logarithmic likelihood units is 

In £(0.85, 0.055eV 2 /c 4 ) - In £(0, 0) = 23.5 (2.7) 

underlining the significance of the additional i> e signal among the event sample. Note that 
the extracted oscillation events N osc scale with the efficiency of the applied cuts and are in 
good agreement with the best fit result stated in ||. 

KARMEN2 collected data from February 1997 through March 2001 corresponding to 
9425 C accumulated proton charge on the ISIS target. A spatial coincidence between the 
initial e + and the neutron capture of 1.3 m 3 was required. Applying all cuts to the data |TU 



15 (e + ,n) candidate sequences were finally reduced. Figure ^| shows the remaining sequences 
in the appropriate energy, time and spatial windows. The background components are also 
given with their distributions. All components except the intrinsic v e contamination are 
measured online in different time and energy windows (see Table [II]) . The extracted number 
of sequences is in excellent agreement with the background expectation, consistent with no 
oscillation signal. To also include the detailed spectral information of each individual event, 
a maximum likelihood method is applied. 

Analogously to the LSND likelihood function, we can define the combined likelihood for 
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FIG. 3: KARMEN2 event ensemble: (a) time of prompt events, (b) energy of prompt events, 
(c) time difference between prompt and delayed event, (d) energy of delayed events, (e) spatial 
correlation and (f) distance to target of prompt event. The 15 oscillation candidates are in very 
good agreement with the background expectation of 15.8 events (solid line). 



the KARMEN sample as 

earn — on 

£=( II Pi), (2-8) 
i=i 

where 

Ncontr. 

Pj(xj) = Yl Qi(xj)- r i ( 2 - 9 ) 

i=l 

with N beam _ on = 15 and N contr . = 5, the oscillation signal as well as 4 background con- 
tributions. For KARMEN 2, the vector x has, of course, a different definition, namely 
x = (E pr ,T pr , Edei, AT, Ax) describing the energy and time relative to beam-on-target of 
the prompt event, the energy of the delayed event as well as the time difference and spatial 
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TABLE II: Expected KARMEN 2 background components and v„— > v e signal 



Process Expectation Determination 



Cosmic induced background 


on i no 

o.y ± u.z 


measured in diff. time window 


Charged current coincidences 


5.1 ±0.2 


measured in diff. energy, time windows 


f e -induced random coincidences 


4.8 ±0.3 


measured in diff. time window 


v e source contamination 


2.0 ±0.2 


MC-simulation 


Total background N{, g 


15.8 ±0.5 




AW (sin 2 (29) = I, Am 2 = 100eV 2 /c 4 ) 


2913 ± 267 





correlation of the prompt and delayed event. Again, normalizations ( |2.3|) and (|2.4j) with 
the appropriate event parameters have to hold. Differing from the likelihood definition in 
the LSND analysis, for KARMEN with its very small background, all background compo- 
nents are combined into one contribution, therefore reducing the above sum ( |2.9| ) to only 



the oscillation signal and the total background, N contr . = 2. Furthermore, the weight for the 
background variation, defined in ( |2.5| ) as a Gaussian factor, is taken as Gamma function, 
reflecting a continuous variation in a Poisson statistics |TU . 



Figure |4| shows the logarithm of the likelihood as a function of the oscillation parameters 
(sin 2 (2G),Am 2 ). The maximum is reached near the physical boundary sin 2 (2Q) = 0, i.e. the 
no-oscillation case. The sharp drop in ln£ towards larger values of sin 2 (2G) demonstrates 
that there is no indication for an oscillation signal. 

A typical approach to deduce confidence regions from likelihood functions would consist 
of defining the contour of an area of given confidence by cutting the likelihood function at 
the corresponding value below the maximum. For a Gaussian shaped likelihood function of 
two uncorrelated free parameters, the corresponding values would be 

Aln£ Gauss = -ln(l - 5/100) = 2.3(4.6) (2.10) 



for S = 90(99) % confidence, respectively [IT]. However, this method leads to correct cover- 
age only in the Gaussian case. As can be seen from Figures and |] the likelihood functions 
have distinct features: An oscillatory behavior as a function of the free parameters, the 
maximum at the physical boundary (for KARMEN), or numerous side maxima with compa- 
rable likelihood values (for LSND). In addition, the parameter space in (sin 2 (20), Am 2 ) is, 
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in principle, not limited, its metric in terms of prior probability density not unequivocally 
defined. 



III. INDIVIDUAL CONFIDENCE REGIONS 

The method we apply in the following is based on a unified frequentist approach sug- 
gested by jH which eliminates the bias that occurs when one decides, after analysing the 
data, between using a confidence interval (having a positive signal) or an upper confidence 
limit (having a result compatible with the background). When first presented, it was ar- 
gued that the suggested ordering principle near the physical boundary should be modified 
]12|] , [|l]| , or that a Bayesian approach to the extracted likelihood function would be more 
appropriate ||14|| . However, many experimental results have been analysed since using the 



unified approach |T3|, also being described as a standard procedure by [|T^ 

The basic idea of the unified frequentist approach is to create a large number of event 
samples in perfect analogy to an experiment. These samples are created by Monte Carlo 
using the full event information for the likelihood procedure. For an oscillation hypothesis 
H with given parameters (sin 2 (2G),Am 2 )#, a large sample of Monte Carlo simulations of 
so-called toy experiments is created. These simulations are based on the detailed knowl- 
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edge of all experimental resolution functions and the spectral information on the individual 
background contributions. In addition, they comprise the expected experimental signal for 



the given oscillation hypothesis f3"I |. For each likelihood function of the analysed samples, 
the estimator Aln£ = lnC max — ln£# is calculated by comparing each sample's likelihood 
maximum with the value for the given input parameters (sin 2 (20),Am 2 )#. The hypothesis 
H is then accepted at a confidence 5, if the estimator A In £ of the experimental likelihood 
function is contained within the smallest 5 % of the simulated estimator distribution. Since, 
in principle, the estimator distribution itself is a function of the oscillation parameters, a 
complete statistical analysis consists of a scan of the entire parameter space (sin 2 (20), Am 2 ) 
to extract the according region of confidence. 



A. KARMEN 



To deduce confidence regions from the KARMEN 2 likelihood function, the parameter 
space (sin 2 (20),Am 2 ) has been scanned extracting the estimator distribution for 8000 dif- 
ferent oscillation hypotheses, including the no-oscillation scenario. From these distributions, 
each containing the information of about 4000 simulated and analysed samples, regions of 
different confidence levels can be calculated. Figure [| shows the regions of the oscilla- 
tion parameters (sin 2 (20), Am 2 ) for confidence levels of 68%, 90% and 95%. Parameter 
combinations to the right contain the complementary confidence. The contours of the con- 
fidence areas are often referred to as exclusion curves of a given confidence. For values 
Am 2 > 100eV 2 /c 4 , the contours cut at oscillation amplitudes of sin 2 (26) = 0.9 ■ 10~ 3 (68 % 
C.L.), sin 2 (26) = 1.7 • lO" 3 (90% C.L.) and sin 2 (26) = 2.2 • lO" 3 (95% C.L.). 

The KARMEN 2 sensitivity, defined as expectation value for the upper limit of a given 
confidence interval under the assumption of no oscillations, is again obtained by simulations: 
(sin 2 (26)) = 0.6(1.6,2.2) • 10~ 3 for 68% C.L. (90%C.L., 95%C.L.), respectively. The error 
on the contour lines is given by the statistical error of the estimator's cut value A In C(5) and 
therefore depends on the amount of simulated samples per hypothesis and the degree 5 of 
confidence under consideration. For example, determining A In £(90%) from a distribution 
of 1000 simulated samples relies on the upper 10 % tail or the highest 100 A ln£ values. We 
derive the error on Aln£ from the spread of the cut value taking the upper 100 ± V100 
samples. For KARMEN 2, the typical relative error on A In £(90 %) is in the range of 2 — 3 %. 
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FIG. 5: KARMEN 2 regions of various confidence. Parameter combinations to the right contain 
the complementary confidence. 

B. LSND 

For the LSND likelihood function, the method to deduce the confidence regions is iden- 
tical to the one described in section |III A| for KARMEN 2. Technically, however, there are 
differences due to the large amount of computing time. This arises from the fact that the 
event samples are much larger (about 1000 events, depending on the oscillation parameters, 
instead of about 15) and the integration over different background contributions according 
to equation ( |2.5| ) is performed in as much as 255 discrete steps of different backgrounds BUB 
and BRB. Therefore, we restricted the hypotheses tested from a fine grid for KARMEN 2 
to some grid points representing the typical variation of expected oscillation events. For 
a fixed oscillation parameter Am 2 = leV 2 /c 4 , 4 oscillation scenarios were simulated with 
1000 individual samples each (see Table [IT]] ). 

As verified by earlier calculations [0] and the KARMEN 2 analysis, the main variation 
of A In C(5) for a given confidence 5 in the parameter space (sin 2 (20),Am 2 ) follows the 
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TABLE III: LSND estimator values A In £ for 3 different confidence levels 5 and varying input 
oscillation signal strength sin 2 (20) but fixed parameter Am 2 = leV 2 /c 4 . 



sin 2 (26) 


N osc 




Aln£ 






DAR+DIF 


68% 


90% 


95% 


0.0 


0.0 


2.25 + 0.2 


4-25181 


5.45l{; 2 


2.5 • 10~ 3 


33.5+0.2 


2.55 + 0.1 


4.05l8;l 


5 15+ 1 ' 8 
°- io -0.7 


5 • 10" 3 


67.1+0.4 


2.65 + 0.1 


4.25l°j 


5-35lo;g 


1 • io- 2 


134.2+0.8 


1.95 + 0.1 


3.55lg 4 


4.55lJ| 



variation of the signal strength, i.e. the number of oscillation events N osc among the event 
sample. We therefore extrapolated the values of Aln£ in Table |TTTj linearly with N osc 
and adopted, at each grid point (sin 2 (26),Am 2 ) with its expected number of oscillation 
events N osc , the estimator value Aln£(sin 2 (20), Am 2 ). Having constructed the estimator 
cut distribution this way, the last step is analogous to that used for KARMEN2, i.e. to 
cut the LSND likelihood function with the given values A In £ (sin (26), Am 2 ) below the 
maximum and draw the contour lines. Figure |6| shows the contour lines of areas containing 
68%, 90% and 95% confidence. Although parameter combinations with Am 2 > 10eV 2 /c 4 
are part of the 90% CL. area, they are scarcely included in the more stringent interval of 
68 % confidence, demonstrating the lower likelihood values for such oscillation scenarios. 

It is useful to compare the extracted confidence regions with the favored regions given in 
where the likelihood function had been calculated based on a larger event sample (5697 
events with 20 < E e < 200 MeV and no i? 7 -cut). In addition, a simplified extraction of 
confidence regions according to equation ( |2.10| ) had been applied |32| . Figure [7] shows, that 
for lower values of Am 2 , there is only a slight shift to larger oscillation amplitudes of the 
new analysis. A large overlap of the 90% CL. area with the region according to A ln£ = 2.3 
demonstrates the good statistical agreement of the analyses of both event samples. For 
higher values of Am 2 , the differences are more pronounced. Compared to the older analysis, 
the confidence region is not only shifted considerably to larger amplitudes, but the likelihood 
values themselves are larger relative to the likelihood maximum which results in a larger 
area of 90%C.L.. These effects can be understood by the upper energy cut E e < 60 MeV 
applied in the actual analysis. Restricting the analysis mainly to the oscillation channel 
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FIG. 6: LSND regions of various confidence. Parameter combinations outside the contours contain 
the complementary confidence. 

Vy,— > v e favors also large values of Am 2 whereas a signal from v^— > u e , derived in || to be 
much smaller, but detectable mainly at higher energies, decreases the likelihood for such 
solutions as well as the absolute strength or oscillation amplitude. 

Finally, we note the importance to derive values of A In £ leading to correct coverage of 
confidence regions. These values differ considerably from the simplified Gaussian approach 
of a constant of 2.3 units. In an earlier analysis of the LSND data ||, the typical estimator 
cut values were A In £(90 %) ~ 2.5 — 3.5 on the basis of about 3000 events. Now, with even 
smaller event samples, the values of A In £ further increase to ~ 3.5 — 4.5. This dependance 
of A In £ is also underlined by the typical values for the much smaller KARMEN 2 sample 
size, where A In £(90%) ranges from 3 to 5. 
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FIG. 7: LSND regions of 90 % and 95 % confidence in comparison with the favored region analysing 
the likelihood function of a larger event sample and applying a constant cut Aln£ = 2.3(4.6), from 
1 

IV. COMPATIBILITY ANALYSIS 

Having analysed both experiments' likelihood functions with the same consistent method, 
we can now use this method and its results to deduce quantitative statements on the question 
of statistical compatibility of both experimental results and, in the case of such compatibility, 
on the common parameter combinations (sin 2 (20),Am 2 ). 

A. Level of compatibility 

One of the most misleading but nevertheless very frequently used interpretation of the 
LSND and KARMEN results is to take the LSND region left over from the KARMEN exclu- 
sion curve as area of (sin 2 (2B),Am 2 ) favored by both experiments. Such an interpretation, 
though appealingly straight forward, completely ignores the information of both likelihood 
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functions and reduces them to two discrete levels of a specific confidence 5. To be able 
to correctly combine the two experimental results and extract the combined confidence re- 
gions, we have to use the original estimator distributions for KARMEN and for LSND. In a 
first step, the level of statistical compatibility of the two experimental outcomes has to be 
quantified. In the second step, the parameters favored by both experiments will be deduced. 

In the following analysis, an experiment or event, in logical terms of frequency or proba- 
bility of occurence, means repeating both, the KARMEN and the LSND experiment. Com- 
patibility is then achieved if there are at least some oscillation parameters being the element 
of both the repeated KARMEN-like and LSND-like experiment's confidence region. 

We make the well justified assumption that the two experiments LSND and KARMEN 
are independent. Then, a two dimensional estimator distribution can be constructed for 
each hypothesis (sin 2 (20), Am 2 )/? from the individual distributions Aln£^ of KARMEN 
and A In Cl of LSND by an inverse projection. For each hypothesis, the pair of experimental 
values (A In £karmen2, A In Clsnd) is checked to be part of the 'inner' 5% of the simu- 
lated 2-dimensional estimator distribution. There are different methods of ordering these 
2-dimensional distributions all leading to very similar results |J . In the following, we require 
each experimental value A Id.Ckarmen2 and A \nC LSND to be contained in the correspond- 
ing 1-dimensional interval of confidence. This selection criterion is equivalent to selecting 
a rectangle of frequency of the 2-dim estimator distribution. The resulting confidence is 
8 = 8karmen-8lsnd- Since we do not weight the experiments, we define Skarmen = 8lsnd, 
so that for a combined confidence of e.g. 81 %, we demand A In Ckarmeni < A In £r-(90 %) 
and A In C LS nd < Aln£ L (90%). 

At a level of Skarmen = Slsnd = 60%, no parameter combination (sin 2 (20),Am 2 ) 
fulfills the requirement (A\iiCkarmen2 < AliaCx) A (A\b.Clsnd < AlnCi) any more. 
This corresponds to the fact that, at the level of combined confidence 

5 mc = 0.6 2 = 36 % , (4.1) 

the two experiments are completely incompatible. Coming back to our definition of prob- 
ability of occurence, in 64% of repetitions of double experiments, a KARMEN 2 plus an 
LSND experiment with their typical parameters and statistics, the outcome would consist 
of statistically compatible results with a specified set of oscillation parameters (sin 2 (26), 
Am 2 ). 



18 



B. Common oscillation parameters 

In the following, we analyse the preferred regions of oscillation parameters in the case of 
compatibility defined in the section before. If two experiments are independent producing 
two likelihood functions as result of the event analysis, the recipe for a combined analysis 
is straight forward. The likelihoods can be multiplied, i.e. in our case the logarithms 
of the likelihood functions are added. The absolute values of the likelihood functions are 
somewhat arbitrary. A recommended presentation of ln£ is to normalize the individual 
functions \tiCkarmen an d liaC LSND to a point in (sin 2 (20),Am 2 ) where they are equally 
sensitive to a potential signal ]T7J. In our case of the oscillation search this corresponds to 
values of sin 2 (20) = 0. Therefore we define the combined likelihood function 

ln£(sin 2 (26), Am 2 ) = {ln£^M^ 2 (sin 2 (2e), Am 2 ) - In £^ M ^ 2 (sin 2 (20) = 0)} 

+ {ln£ L5iV D(sin 2 (20), Am 2 ) - In C LSND {an 2 (2G) = 0)} . (4.2) 




FIG. 8: Combined KARMEN2 and LSND logarithmic likelihood function ln£(sin 2 (2G), Am 2 ) 

Figure |8] shows the combined function In £(sin 2 (20), Am 2 ) with a maximum of 
ln£(sin 2 (2O)=l,Am 2 =0.05)=21.5 on a long flat 'ridge' of low Am 2 values. The positive 
signal of LSND dominates the combined likelihood. However, the maximum in comparison 
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FIG. 9: Regions of various confidence for the combined analysis assuming statistical compatibility 
of KARMEN2 and LSND. 

to the no-oscillation value is reduced (see Equ. |2.7|) as well as the shape at higher values of 
Am 2 is significantly modified due to the KARMEN 2 likelihood function. 

To determine the confidence regions in (sin 2 (20),Am 2 ), again we apply the unified 
approach, i.e. we create the estimator distribution A\n£ K+L for various hypotheses 
(sin 2 (20),Am 2 )# and compare the experiment's value A In jCkarm EN2+ lsn d with the cut 
value Aln £k+l{5) for a given confidence. To get the estimator, a simulated event 
sample now consists of a KARMEN 2-like and an LSND-like MC sample each analysed 
with the appropriate likelihood definitions. Then both likelihood functions are added 
following equation ( P~2"| ) and the estimator Ahi£ K+L = In £ K+L (sm 2 (2Q), Am 2 ) max — 
ln£^ +i (sin 2 (26), Am 2 ) H is calculated. The typical cut values for a confidence of 5 = 90 % 
are slightly higher than the individual LSND ones, ranging from 3.5 to 5.5. Figure ^| shows 
the confidence regions of the oscillation parameters for the combined likelihood analysis. The 
total confidence of a parameter region is hereby reduced by the fraction of incompatibility 
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of the two experiments, so 

5 tot = 6-(l-6 mc ) (4.3) 

which results in e.g. 5 to t = 0.9 • 0.64 = 58 % total confidence for the parameter combinations 
within the area denoted as 90% CL. area in Figure |9|. 

The combination of both experiments' results with this consistent frequentist approach 
demonstrates that z/ M — > v e solutions with Am 2 > 10eV 2 /c 4 are excluded. There remain es- 
sentially two solutions in the parameter space of — > v e oscillations, one at Am 2 pa 7eV 2 /c 4 
and the area with Am 2 < leV 2 /c 4 . The latter one, though graphically rather large in 
Figure |9| corresponds to just one solution in the 'phase space' of oscillations: Any u e 
signal from oscillation has rather low energy, the evolution of the oscillation probability 
(equ. |l.l| ) being just at the beginning of the oscillation length. With an oscillation param- 
eter Am 2 = 0.5eV 2 /c 4 , and a typical lower energy of E v = 20MeV from /i + decay at rest, 
the first maximum of oscillations of into v e would be at a distance 

71 E v 

d\ max = — ■ — — —. — 7T Rj 50 m (4.4) 
2 1.27 -Am 2 v ' 

from the neutrino source. For such oscillation parameters, the negative result of KARMEN 2 
compared to the excess of LSND mainly reflects the different detector distances cIkarmen ~ 
17 m versus (Ilsnd ~ 30 m from the source. This is one way to reconcile the results of the 
two experiments. 

To summarize, at a joint confidence level of 5 to t = 0.36 + 0.64 • 0.68 ~ 80 %, the two 
experiments are either incompatible or lead to just one single oscillation solution at Am 2 < 
leV 2 /c 4 . The remaining 20% confidence separate into an enlargement of the parameter 
region of low Am 2 values and into a second oscillation solution at Am 2 w 7eV 2 /c 4 . 



V. CONCLUSION 



We have analysed both the KARMEN 2 and the LSND final data with a maximum 
likelihood method using a similar event-based likelihood function. The likelihood functions 
as functions of the free parameters sin 2 (20) and Am 2 demonstrate the different outcomes 
of the experiments, namely a clear, statistically significant excess of v e in LSND versus no 
indication of an oscillation signal in KARMEN 2. To deduce regions of correct coverage, we 
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FIG. 10: Parameter regions deduced in this work (grey area) compared with existing limits of 



experiments (Bugey v e — >v x CCFR 



and NOMAD v^— ► v e P0|) and the envisaged 



sensitivity of the MiniBooNE experiment (with final single horn design 



applied a unified frequentist approach to both likelihood analyses individually. The results 
underline the feasibility of as well as the necessity for such an approach. 

A quantitative joint statistical analysis has been performed leading to a level of 36 % 
incompatibility of the experimental outcomes, corresponding to individual confidence levels 
of 60%. For the cases of statistical compatibility, the common parameter regions have been 
identified on the basis of the unified frequentist approach applied to the combined likelihood 
function of KARMEN 2 and LSND. The derived confidence regions in (sin 2 (26), Am 2 ) clearly 
differ from an often applied but incorrect graphical overlap of the confidence regions of the 
individual experiments. There are two oscillation scenarios with either Am 2 rs 7eV 2 /c 4 or 
Am 2 < leV 2 /c 4 compatible with both experiments. 

We performed a joint statistical analysis incorporating some of the systematic uncertain- 
ties of the experiments, such as neutrino flux uncertainty, accuracy of known cross sections 
and resolution functions of both experiments. Further -unknown- systematic uncertainties 
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might become evident only by performing new experiments to confirm or discard the results 
described here. Figure |n] shows the intended sensitivity of a new experiment, MiniBooNE 



at Fermilab [21], which is under construction and will independently crosscheck the LSND 
evidence. 

In addition, we did not incorporate the results of other experiments on the oscillation pa- 
rameters investigated. As shown in Figure [TO, the deduced favored region in (sin 2 (2B),Am 2 ) 
is partly overlaped by 90% CL. exclusion curves of other experiments. In particular, the re- 
cent NOMAD v^— > u e result |20 clearly reduces the overall likelihood for the Am 2 rs 7eV 2 /c 4 
solution. A complete analysis should include these results on the basis of the same statis- 
tical method, i.e. a consistent frequentist analysis. This implies, however, the detailed 
knowledge of experimental data and resolution functions of these experiments not accessi- 
ble to us. Furthermore, the exclusion curve from the Bugey experiment is based on the 
disappearance search v e — > v x . Combining this experiment correctly with the appearance 
results of v^— > v e or v^— * u e in terms of mixing angles would therefore also require a full 
three- or four-dimensional mixing scheme with theoretical models including sterile neutri- 
nos PI G3L M El I 



2?H or CPT violation p8] and would become model-dependent. 
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